• 专利附录
  • 专利说明
  • 权利要求
  • 类似技术
  • 同族专利
  • 引用文献
  • 法律状态
  • 优先权
    • 专利摘要:
    The invention relates to a method and corresponding system for real-time simulation of N moving or stationary sound sources in a space surrounding a listener, which method processes N input signals, each of which represents one of the N sound sources, thereby obtaining one or more output signals (10, 66, 92, 93) for a listening device, such as a left output signal (yL(t)) and a right output signal (yR(t)) for a stereophonic headphone (98, 99) or the like, which method comprises using solely a single set of fixed filters (57, 58, 59, 60) to simulate all of said N moving or stationary sound sources. The method and system of the invention provide an efficient method for creating many simultaneous sound sources relative to a listener using very low signal processing power. By application of the principles of the invention there is provided a method and corresponding system by means of which it is possible to support head-movements of the listener as well as movements of the simulated sound sources relative to the listener, that offer a good spatial resolution of simulated sound sources and that enables real-time simulation of spatial sound images without the use of detailed or even individualized head-related transfer functions (HRTFs).
    公开号:DK201901174A1
    申请号:DKP201901174
    申请日:2019-10-05
    公开日:2021-04-22
    发明作者:Minnaar Pauli
    申请人:Idun Aps；
    IPC主号:
    专利说明:

    [1] [1] J. Blauert, “Spatial hearing: The psychophysics of human sound localization”, MIT Press, Revised edition, 1997.
    [2] [2] H. Møller, M. F. Sørensen, D. Hammershøi, C. B. Jensen, “Head-related transfer functions of human subjects”, J. Audio Eng. Soc., Vol. 43, No. 5, pp. 300-321, 1995.
    [3] [3] M. Noisternig, A. Sontacchi, T. Musil, and R. Héldrich, “A 3D ambisonic based binaural sound reproduction system,” AES 24th International Conference on Multichannel Audio, Audio Engineering Society, 2003.
    [4] [4] J. Vennerød, “Binaural Reproduction of Higher Order Ambisonics - A Real-Time Implementation and Perceptual Improvements”, Master thesis, Norwegian University of Science and Technology, 2014.
    [5] [5] A. Allen, Google Inc., “Symmetric spherical harmonic HRTF rendering”, US10009704B1,
    [6] [6] A. Kruger, E. Rasumow, Sennheiser Electronic Gmbh, “Method and Device For Processing A Digital Audio Signal For Binaural Reproduction”, WO2018149774A1, 2017.
    [8] [8] V. Larcher, J.-M. Jot, J. Guyard, and O. Warusfel, "Study and Comparison of Efficient Methods for 3-D Audio Spatialization Based on Linear Decomposition of HRTF Data", 108" Conv. Audio Engineering Society, paper no. 5097, 2000.
    [9] [9] D. Marelli, R. Baumgartner, P. Majdak, “Efficient Approximation of Head-Related Transfer Functions in Subbands for Accurate Sound Localization”, IEEE/ACM Trans. Audio, Speech & Language Processing 23 (7), pp. 1130-1143, 2015.
    权利要求:
    Claims (13)
    [1] 1. A method for real-time implementation of head-related transfer functions (HRTFs), which method comprises providing one or more fixed filters (18, 19, 20, 25’), a corresponding filter input addition unit (49, 50, 51, 52) for each of the fixed filters (18, 19, 20, 25), a corresponding controllable gain unit (15, 16, 17, 25) for each of the fixed filters (18, 19, 20, 25°), a controllable delay unit (8) and a filter output addition unit (24), where the method comprises: — providing an input signal (1) to the controllable delay unit (8), thereby obtaining a delayed version (1°) of the input signal (1); — providing the delayed version (1°) of the input signal (1) via each respective of said controllable gain units (15, 16, 17, 25) to the corresponding fixed filter (18, 19, 20, 25) via a corresponding filter input addition unit (49, 50, 51, 52), thereby obtaining a corresponding delay and gain adjusted and filtered signal (21, 22, 23, 26) as the output signal of each respective of said fixed filters (18, 19, 20, 25"); — providing said one or more delayed and gain adjusted and filtered signals (21, 22, 23, 26) to said filter output addition unit (24); — in the output addition unit (24) adding said delayed and gain adjusted and filtered signals (21, 22, 23, 26) provided to the output addition unit (24), whereby an output signal (10) is obtained that represents the input signal (1) processed through the real- time implementation of a HRTF, which HRTF can be varied solely by varying the delay provided by the delay unit (8) and the gain provided by the respective gain units (15, 16, 17, 25).
    [2] 2. A method according to claim 1, wherein control of said controllable delay unit (8) and said controllable gain units (15, 16, 17, 25) is based on the spatial position of sound sources relative to the head of the listener, or another reference point in the vicinity of the listener, such that the delays and gains depend on the azimuth and elevation of the respective sound sources or on other spatial coordinates characterizing the position of the sound sources relative to the head or other reference point of the listener.
    [3] 3. A method according to any of the preceding claims, wherein the number of said fixed filters is preferably 4 or less, more preferably 3 or less and still more preferably 2 or less.
    [4] 4. A method according to any of the preceding claims, wherein said one or more fixed filters are IIR filters, 1
    DK 2019 01174 A1
    [5] 5. A method according to any of the preceding claims, wherein said one or more fixed filters are low-order filters, preferably of order 4 or less, more preferably of order 3 or less and still more preferably of order 2 or less.
    [6] 6. A method according to any of the preceding claims, wherein said fixed filters (18, 19, 20, 25’) belong to the group of low-pass, high-pass, band-pass, notch and shelving filters.
    [7] 7. A system for real-time implementation of head-related transfer functions (HRTFs), which system comprises a set of one or more fixed filters (18, 19, 20, 25) configured to be used for implementing any HRTF by the system, a corresponding filter input addition unit (49, 50, 51, 52) for each of the fixed filters (18, 19, 20, 25’), a corresponding controllable gain unit (15, 16, 17, 25) for each of the fixed filters (18, 19, 20, 25’), a controllable delay unit (8) and a filter output addition unit (24), wherein the system further comprises: — an input configured to receive an input signal (1) and providing the input signal (1) to the controllable delay unit (8), thereby obtaining a delayed version (1°) of the input signal (1); — where the system is configured for providing the delayed version (1°) of the input signal (1) via each respective of said controllable gain units (15, 16, 17, 25) to the corresponding fixed filter (18, 19, 20, 25’) via a corresponding filter input addition unit (49, 50, 51, 52), thereby obtaining a corresponding delay and gain adjusted and filtered signal (21, 22, 23, 26) as the output signal of each respective of said fixed filters (18, 19, 20, 25); — where the system is configured for providing said one or more delay and gain adjusted and filtered signals (21, 22, 23, 26) to said filter output addition unit (24) that adds said delay and gain adjusted and filtered signals provided to the filter output addition unit (24), such that an output signal (10) is provided by the output addition unit (24) that represents the input signal (1) processed through the real-time implementation of a an HRTF, which HRTF can be varied solely by varying the delay provided by the delay unit (8) and the gain provided by the respective gain units (15, 16, 17, 25).
    [8] 8. A method for real-time simulation of N moving or stationary sound sources in a space surrounding a listener, which method processes N input signals, each of which represents one of the N sound sources, thereby obtaining one or more output signals (10, 66, 92, 93) for a listening device, such as a left output signal (y.(t)) and a right output signal (yr(t)) for a stereophonic headphone (98, 99) or the like, which method comprises using solely a single set of fixed filters (57, 58, 59, 60) to simulate all of said N moving or stationary sound sources.
    2
    DK 2019 01174 A1
    [9] 9. A method according to claim 8, wherein the method for each of said one or more output signals comprises; providing one or more fixed filters (57, 58, 59, 60), a corresponding filter input addition unit (49, 50, 51, 52) for each of the fixed filters (57, 58, 59, 60) and a common filter output addition unit (65), where the method further comprising for each of said N sound sources providing a respective controllable delay unit (28, 31) and one or more controllable gain units (33, 34, 35, 36; 37, 38, 39, 40), where the method further comprises: — for each of said N sound sources providing information defining the position in space of the respective sound source; — providing N input signals (27, 30) representing each respective of said N sound sources to the corresponding controllable delay unit (28, 31), thereby obtaining delayed versions (29, 32) of the respective input signals (27, 30); — providing the delayed version (29, 32) of the input signals (27, 30) via each respective of said controllable gain units (33, 34, 35, 36; 37, 38, 39, 40) corresponding to each respective of said N sound sources to the corresponding fixed filter (57, 58, 59, 60) via the corresponding filter input addition unit (49, 50, 51, 52), thereby obtaining a corresponding delayed and gain adjusted and filtered signal (61, 62, 53, 64) as the output signal of each respective of said fixed filters (57, 58, 59, 60); — providing said one or more delay and gain adjusted and filtered signals (61, 62, 63, 64) to said filter output addition unit (65); — in the filter output addition unit (65) adding said delay and gain adjusted and filtered signals (61, 62, 63, 64) provided to the filter output addition unit (65), whereby a resulting output signal (10, 66, 92, 93) is obtained that represents the N input signals (27, 30) processed through the real-time implementation of a HRTF corresponding to each respective position in space of the respective sound source, which HRTFs can be varied solely by varying the delay provided by the delay unit (8) and the gain provided by the respective controllable gain units (33, 34, 35, 36; 37, 38, 39, 40), and — providing the resulting output signal (10, 66, 92, 93) to the listening device.
    [10] 10. A system for providing natural sounding interactive binaural synthesis that can support a moving listener and one or more simultaneous moving sound sources, the system comprising a signal processing unit (95) configured to execute the method according to any of the preceding claims 1 to 6 or 8 to 9, the system being configured to receive one or more source signals (102) and providing a set of output signals (96, 97) for a listening device such as a 3
    DK 2019 01174 A1 headphone (98, 99), where the listening device is provided with tracking means (100) configured to track the movements of a user's head and providing a control signal (101) to the signal processing unit (95), such that the controllable delay units and controllable gain units are controlled by the tracking means provided on the listening device.
    [11] 11. A system according to claim 10, wherein said signal processing unit (95) furthermore is configured for receiving and processing control signals (104) provided by source tracking means (105) related to one or more sound sources (102) thereby enabling the signal processing unit (95) to control the controllable delay units and controllable gain units not only based on the movement of a user wearing the listening device but also on the movement of the sound sources relative to the listening device.
    [12] 12. A system according to claim 10 or 11, which system is configured to receive and process N input signals, each of which represents one of the N sound sources, thereby obtaining one — or more output signals (10, 66, 92, 93) for a listening device, such as a left output signal (y.(t) and a right output signal (yr(t)) for a stereophonic headphone (98, 99) or the like, where the system comprises a single set of fixed filters (57, 58, 59, 60) configured to process all of said N input signals representing the N moving or stationary sound sources.
    [13] 13. A system according to claim 12, wherein the system for each of said one or more output signals comprises; one or more fixed filters (57, 58, 59, 60), a corresponding filter input addition unit (49, 50, 51, 52) for each of the fixed filters (57, 58, 59, 60) and a common filter output addition unit (65), wherein the system for each of said N sound sources further comprises a respective controllable delay unit (28, 31) and one or more controllable gain units (33, 34, 35, 36; 37, 38, — 39, 40), wherein the system comprises: — (for each of said N sound sources means for providing information determining the position in space of the respective sound source; — means for receiving N input signals (27, 30) representing each respective of said N sound sources and providing these signals to the corresponding controllable delay unit (8), thereby obtaining delayed versions (29, 32) of the respective input signals (27, 30); — wherein the delayed version (29, 32) of the input signals (27, 30) are provided via each respective of said controllable gain units (33, 34, 35, 36; 37, 38, 39, 40) corresponding to each respective of said N sound sources to the corresponding fixed filter (57, 58, 59, 4
    DK 2019 01174 A1 60) via a corresponding filter input addition unit (49, 50, 51, 52), thereby obtaining a corresponding delay, and gain adjusted and filtered signal (61, 62, 53, 64) as the output signal of each respective of said fixed filters (18, 19, 20, 25"); — wherein said one or more delay and gain adjusted and filtered signals (61, 62, 63, 64) are provided to said filter output addition unit (65); — in the filter output addition unit (65) adding said delay and gain adjusted and filtered signals (61, 62, 63, 64) provided to the filter output addition unit (65), whereby a resulting output signal (10, 66, 92, 93) is obtained that represents the N input signals (27, 30) processed through the real-time implementation of a HRTF corresponding to the each respective position in space of the respective sound source, which HRTF can be varied solely by varying the delay provided by the respective controllable delay unit (8) and the gain provided by the respective controllable gain units (33, 34, 35, 36; 37, 38, 39, 40), and — providing the resulting output signal (10, 66, 92, 93) to the listening device.
    5
    类似技术:
    公开号 | 公开日 | 专利标题
    US5438623A|1995-08-01|Multi-channel spatialization system for audio signals
    CN107852563B|2020-10-23|Binaural audio reproduction
    US9197977B2|2015-11-24|Audio spatialization and environment simulation
    JP4938015B2|2012-05-23|Method and apparatus for generating three-dimensional speech
    KR102149214B1|2020-08-28|Audio signal processing method and apparatus for binaural rendering using phase response characteristics
    US6421446B1|2002-07-16|Apparatus for creating 3D audio imaging over headphones using binaural synthesis including elevation
    JP2006203850A|2006-08-03|Sound image locating device
    JP2000197195A|2000-07-14|System and method radiating three dimensional sound from speaker
    Hacihabiboglu et al.2017|Perceptual spatial audio recording, simulation, and rendering: An overview of spatial-audio techniques based on psychoacoustics
    JP2000152397A|2000-05-30|Three-dimensional acoustic reproducing device for plural listeners and its method
    JP2009077379A|2009-04-09|Stereoscopic sound reproduction equipment, stereophonic sound reproduction method, and computer program
    EP3225039B1|2021-02-17|System and method for producing head-externalized 3d audio through headphones
    CN108616789B|2021-01-01|Personalized virtual audio playback method based on double-ear real-time measurement
    JP6515720B2|2019-05-22|Out-of-head localization processing device, out-of-head localization processing method, and program
    US10321252B2|2019-06-11|Transaural synthesis method for sound spatialization
    Novo2005|Auditory virtual environments
    CN113170271A|2021-07-23|Method and apparatus for processing stereo signals
    DK180449B1|2021-04-29|A method and system for real-time implementation of head-related transfer functions
    JP2006128870A|2006-05-18|Sound simulator, sound simulation method, and sound simulation program
    CN109923877B|2020-08-25|Apparatus and method for weighting stereo audio signal
    KR20090129727A|2009-12-17|Virtual speaker system of three dimensions with equalizer and control method thereof, recording medium recording program which has control method thereof
    JP7038725B2|2022-03-18|Audio signal processing method and equipment
    Otani et al.2017|Dynamic crosstalk cancellation for spatial audio reproduction
    Vorländer2020|3D Sound Reproduction
    KR20030002868A|2003-01-09|Method and system for implementing three-dimensional sound
    同族专利:
    公开号 | 公开日
    DK180449B1|2021-04-29|
    WO2021063458A1|2021-04-08|
    引用文献:
    公开号 | 申请日 | 公开日 | 申请人 | 专利标题
    WO2007101958A2|2006-03-09|2007-09-13|France Telecom|Optimization of binaural sound spatialization based on multichannel encoding|
    CN102572676B|2012-01-16|2016-04-13|华南理工大学|A kind of real-time rendering method for virtual auditory environment|
    US10009704B1|2017-01-30|2018-06-26|Google Llc|Symmetric spherical harmonic HRTF rendering|
    DE102017102988B4|2017-02-15|2018-12-20|Sennheiser Electronic Gmbh & Co. Kg|Method and device for processing a digital audio signal for binaural reproduction|
    法律状态:
    2021-04-22| PAT| Application published|Effective date: 20210406 |
    2021-04-29| PME| Patent granted|Effective date: 20210429 |
    优先权:
    申请号 | 申请日 | 专利标题
    DKPA201901174A|DK180449B1|2019-10-05|2019-10-05|A method and system for real-time implementation of head-related transfer functions|DKPA201901174A| DK180449B1|2019-10-05|2019-10-05|A method and system for real-time implementation of head-related transfer functions|
    PCT/DK2020/000279| WO2021063458A1|2019-10-05|2020-10-01|A method and system for real-time implementation of time-varying head-related transfer functions|
    [返回顶部]